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Method and System For See-Through Image Correction In Image Duplication 
Field of the Invention 

5 

The current invention is generally related to an image duplication technique, and 
more particularly related to a method of and a system for correcting a see through image on 
a semi-transparent image-carrying medium. 

10 BACKGROUND OF THE INVENTION 

As disclosed in Japanese Patent Office Publication (JPOP) 09-186836, an image 
duplication device such as a digital photocopier utilizes digital data. The digital 
photocopier scans an input document and generates analog image data. The digital copier 

1 5 converts the analog scanner output data into output digital data format and stores it in a 
fi-ame memory. Then, the digital copier outputs the digital image from the frame memory 
to a printer engine in order to generate a reproduction image. Alternatively, the digital 
photocopier stores the above digital data in a secondary memory imit such as a floppy disk 
or a hard disk, and at a later output time, the digital photocopier outputs the stored digital 

20 image data from the secondary memory storage unit to a printer engine. Similarly, the 
digital photocopier processes the stored digital image data into a print image signal in a 
frame memory while accessing font information in response to a print command from a 
terminal device such as a personal computer via LAN, serial interface and or parallel 
interface. The digital photocopier ultimately sends the processed image data to the printer 

25 engine. 

In duplicating an unage scanned from an input docimient, a digital photocopier 
scans a document that has printed information on both front and back of the page. It is 
possible to see through some dark image from the other side of a document since some 
30 image-carrying medium such as paper is semi-transparent. When a digital photocopier 
scans an image from one side of a double-sided docimient, a see-through image from the 
other side is sometimes undesirably scanned together. In order to avoid the see-through 
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image, one exemplary prior art reference such as JPOP06-14185 discloses an image 
processing device determines a see-through image based upon an image intensity level 
histogram. The prior art image processing further utilizes the intensity value of the 
scanned see-through image portion as a color background to correct the see-through image 
5 area. Another exemplary prior art reference such as JP0P9-1 16753 discloses an image 
processing device that reads a predetermined see-through image on a certain image- 
carrying medium and cancels any see-through image from input image data. 

Despite the above described prior art techniques, the see-through image problem 
10 remains to be improved. For example, wh.Qn a see-through image is considered as a color 
background, and the intensity level is corrected as disclosed in JPOP06-14185, the 
gradation is sacrificed. A corrected output image cannot reproduce any image portion 
having an intensity level that is lower than that of the see-through image portion and lacks 
the accuracy. Furthermore, since the correction method is a discontinuous intensity 
15 correction, the output image has non-smooth appearance. Similarly, the cancellation 
method as disclosed in JPOP9-1 16753 also fails to produce a desirable image since the 
. dynamic range of the image is limited. The current invention is directed to solve these and 
other problems related to the see-through images during image duplication. 

20 SUMMARY OF THE INVENTION 

In order to solve the above and other problems, according to a first aspect of the 
current invention, a method of substantially eliminating the undesirable see-through back 
image problem in duplicating double-sided documents, including: scanning a front side 

25 image and a back side image from the double-sided document, the front side image having 
portions, some of the portions including an original front image and a see-through back 
image from the back side image; storing the front side image and the back side image; 
determining an edge amount for each of the portions in the front side image; initially 
separating the see-through back image from the original front image based upon the edge 

30 amount to genemte a first process result; smoothing the portions having a certain amount 
of the edge amount in the first process result to generate a smoothed result; further 
separating character portions and dot pattern portions from background in the smoothed 
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result to leave background portions; and correcting an intensity level of the character 
portions, the dot pattern portions and the background portions using a corresponding 
predetermined conversion function so as to substantially eliminate the see-through back 
image. 

5 

According to a second aspect of the current invention^ a system for substantially 
eliminating the undesirable see-through back image problem in duplicating double-sided 
documents, including: a scanner for scanning a front side image and a back side image 
from the double-sided document, the front side image having portions, some of the 
10 portions including an original front image and a see-through back image from the back side 
image; a memory unit connected to the scanner for storing the front side image and the 
13 back side image; an edge amount determination unit conaected to the memory unit for 

determining an edge amount for each of the portions in the front side image; a smoothing 
§ imit connected to the edge amount determination unit and the memory unit for smoothing 

y 1 5 the portions having a certain amount of the edge amoimt in the first process result to 

. f\ generate a smoothed result; a determination unit connected to the edge amount 

i U determination unit and the smoothing unit for initially separating the see-through back 

I -I image from the original front image based upon the edge amount to generate a first process 

1£l result, the determination unit fijrther separating character portions and dot pattern portions 

j?l 20 from background in the smoothed result to leave background portions; and a correction 

O unit connected to the determination unit for correcting an intensity level of the character 

portions, the dot pattern portions and the background portions using a corresponding 
predetermined conversion function so as to substantially eliminate the see-through back 
image. 

25 

These and various other advantages and features of novelty which characterize the 
invention are pointed out with particularity in the claims annexed hereto and forming a part 
hereof. However, for a better understandmg of the invention, its advantages, and the 
objects obtained by its use, reference should be made to the drawings which form a further 
30 part hereof, and to the accompanying descriptive matter, in which there is illustrated and 
described a preferred embodiment of the invention. 
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FIGURE 1 is a block diagram illustrating one preferred embodiment of the digital 
photocopier according to the current invention. 

5 

FIGURE 2 is a block diagram illustrating one preferred embodiment of the image 
data control unit according to the current invention. 

FIGURE 3 is a block diagram illustrating components of one preferred 
10 embodiment of the image process unit according to the current invention. 

FIGURE 4 is a block diagram illustrating another preferred embodiment of the 
image process imit according to the current invention. 

15 FIGURE 5 is a block diagram illustrating one preferred embodiment the image 

memory access control unit according to the current invention. 

FIGURE 6 is a block diagram illustrating one preferred embodiment the video 
control unit according to the current invention. 

20 

FIGURE 7 A is a graph illustrating exemplary front image data. 

FIGURES 7BI5 7B2 and 7B3 are graphs respectively illustrating back image 

data. 

25 

FIGURE 8 is a block diagram illustrating one preferred embodiment of the see- 
through back image correction process unit according to the current invention. 

FIGURE 9 illustrates an exemplary filter LL 

30 

FIGURE 1 OA is a graph illustrating the edges as represented by peaks. 
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FIGURE 1 OB is a graph that rq)resents a smoothed image for an original front 
image as shown in FIGURE 7 A. 

FIGURE 1 1 illustrates an exemplary smoothing filter. 

5 

FIGURE 12 illustrates an exemplary gamma characteristic conversion line. 

FIGURE 13A is a graph depicting the edge detection data from the edge amount 
detection xmit that has been binarized by the determination unit. 

10 

FIGURE 13B depicts that the extracted edge portion is expanded to neighboring 
areas such as to four neighboring. 



FIGURE 14 describes a third preferred process of substantially eliminating the 
15 undesirable see-through back image problem in duplicating two-sided documents 
according to the current invention. 



FIGURE 15 is a diagram illustrating a fourth preferred embodiment for 
substantially eliminating the undesirable see-through back image problem in duplicating 
20 two-sided documents according to the current invention. 



FIGURE 16 is a flow chart illustrating steps involved in a preferred process of 
substantially eliminating the undesirable see-through back image problem in duplicating 
two-sided documents according to the current invention. 

25 

FIGURE 17A is a graph illustrating a front dot pattern image. 

FIGURE 17B is a graph illustrating a front dot pattern image after removing a 
see-through back image. 

30 

FIGURE 18A illustrates an oscillation spectrum after the DTF is appUed to a 
front image of an output image data. 
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FIGURE 18B illustrates an oscillation spectrum of a see-through back image. 

FIGURE 19A diagrammatically illustrates the image data in the main scanning 
5 direction, and the same waveform periodically repeats for the front dot pattern image. 

FIGURE 19B is the same waveform which fails to periodically repeat for the see- 
through back image. 

10 FIGURE 20 is an N X 3 pixel matrix for determining a peak and a valley of an 

image. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 

1 5 Referring now to the drawings, wherein like reference numerals designate 

corresponding structures throughout the views^ and referring in particular to FIGURE I5 a 
block diagram illustrates one preferred embodiment of the digital photocopier according to 
the current invention. A scanner unit 1 of the digital photocopier projects hght onto a 
document surface and optically reads characters and images by focusing the reflected light 

20 from the document surface onto a CCD via a group of mirrors and lenses. A sensor board 
unit 2 converts the front and back image signal from the CCD to digital signals and outputs 
the digital signals to an image data control unit 3. The image data control tmit 3 controls 
the data transfer among an image process unit 4, a parallel bus 5 and an image memory 
access control unit 6. The image data control unit 3 also controls the entire system controls 

25 such as commimication between a system control unit 7 and a process control unit 8. The 
process control unit 8 controls various processes that act on the image data. In general, the 
image data inputted into the image data control unit 3 is transferred to the image process 
unit 4, and the image process unit 4 corrects the signal degradation associated with the 
digitization and the optics. The image process unit 4 outputs back to the corrected image 

30 data to the image data control unit 3. In response, the image data control unit 3 transfers 
the corrected image data to the image memory access control unit 6 via the parallel bus 5. 
The image memory access control unit 6 controls the transferred corrected image data and 
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the memory access of a memory unit 9 under the control of the system control unit 7. In 
addition, the image data control unit 3 processes the data from an external personal 
computer 10 for printing as well as compresses or decompresses the image data for the 
efficient storage in the memory unit 9. The image memory access control unit 6 reads the 
5 front and back compressed image data from the memory unit 9 for printing and 

decompressed the image data back to the original image data which is transferred to the 
image data control unit 3 via the parallel bus 5. 

Still referring to FIGURE 1, upon receiving the front and back image data from 
10 the image memory access control irnit 6, the image data control unit 3 outputs the above 
image data as output image data to the image process unit 4. The image process xmit 4 
corrects see-through image by simultaneously referring to the front image and the back 
image and outputs the corrected image data to a video data control unit 1 1. In turn, the 
video control unit 1 1 performs a predetermined pulse control on the output image data and 
15 transfers the processed image data to an image formation unit or a printer engine 12 for 
forming a reproduced image on an image-carrying medium. 

If the scanned image data is to be faxed, the scanned data is transferred from the 
image data control unit 3 to the image process unit 4, where the image data is processed as 

20 described. The processed image data is now transferred from the image process unit 4 to a 
facsimile control unit 13 via the parallel bus 5. The facsimile control unit 13 performs a 
predetermined data conversion on the processed image data before transferring to a 
communication network and outputs the converted image data as facsimile data on a public 
network 14. Conversely, the facsimile control unit 13 converts the facsimile data from the 

25 public network 14 into the predetermined image data and sends the image data to the image 
process unit 4 via the parallel bus 5 and the image data control unit 3. In case of the 
facsimile transmission, the image process unit 4 does not perform any special process and 
transfers the image data to the video data control xmit 1 1 . In turn, the video control unit 1 1 
performs a predetermined pulse control and a predetermined dot rearrangement on the 

30 output image data and transfers the processed image data to an image formation unit or a 
printer engine 12 for forming a reproduced image on an image-carrying medium. 
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Under the circumstances where the above described multiple output jobs such as 

copying, faxing and printing or associated processes are taking place in parallel, the system 
control unit 7 along with ROM 15 and RAM 16 controls the entire system by allocating the 
resources. Similarly, the process control unit 8 along with ROM 15 and RAM 16 controls 
5 the flow of the image data. An operation panel 19 inputs a selection from the above 
described various jobs. The system control unit 7 and the process control unit 8 
communicate with each other via the parallel bus 5, a serial bus 20 and the image data 
control unit 3. The image data control imit 3 converts the data format for interfacing 
between the parallel bus 5 and a serial bus 20. A bus control unit of a bus mediation unit 
10 21 mediates the right to use the parallel bus 5 in case of simultaneous multiple bus 
requests. 

In the following, the more detail description is provided for the image data 
control unit 3, the image process unit 4, the image memory access control unit 6, the video 
15 data control unit 1 1 and the facsimile control unit 13 of a mxilti-fimctional digital image 
reproduction device. 

Now referring to FIGURE 2, a block diagram illustrates one preferred 
embodiment of the image data control unit 3 according to the ciorrent invention. The image 

20 data control unit 3 further includes an image data input/output (I/O) control unit 30, a 

command control unit 31, an image data input control unit 32, an image data output control 
unit 33, a data compression unit 34, a data decompression unit 35, a data conversion unit 
36, a serial data interface (I/F) unit 38 and a parallel data interface (I/F) unit 39. The 
scanned image data from the sensor board unit 2 is inputted to the image data I/O control 

25 imit 30 and is further outputted from the image data I/O control unit 30 to the image 

process unit 4. The image process unit 4 corrects the image data and outputs the corrected 
image data to the data compression unit 34 via the image data input control unit 32. fri 
order to increase the transfer rate in the parallel bus 5, the data compression unit 34 
compresses the image data, and the data conversion unit 36 outputs the converted image 

30 data to the parallel bus via the parallel data I/F unit 39. In the other direction, the 

compressed data is sent to the data decompression imit 35 via the parallel data I/F unit 39 
and the data conversion unit 36. After the image data is decompressed in the data 
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decompression unit 35, the image data output control unit 33 outputs the decompressed 
image data to the image process unit 4. The data conversion unit 36 interchangeably 
converts both the serial data and the parallel data for communication between the system 
control unit 7 and the process control unit 8. The two tier serial data I/F units 38 and 39 
5 control communication between the image process unit 4 and the serial bus 20. 

Now referring to FIGURE 3, a block diagram illustmtes components of one 
preferred embodiment of the image process unit 4 according to the current invention. The 
image process xrnit 4 further includes a first input interface (I/F) unit 40, a scanner image 

10 process xmit 41, a first output I/F unit 42, a second input I/F xmit 43, a see-through back 
image correction unit 44, an image quality control unit 45, a second output I/F unit 46 and 
a command control unit 47. The scanned image data from the image data control unit 3 is 
inputted to the first input I/F unit 40 and is further outputted from the first input I/F unit 40 
to the scanner image process unit 41 . The scanner image process unit 41 processes the 

15 image data by shade correction, scanner y correction, MTF correction as well as 

enlargement/reduction. The scaimer image process unit 41 outputs the corrected image 
data to the image data control unit 3 via the first output I/F unit 42. The output image data 
from the image data control unit 3 is inputted to the second input I/F unit 43 and is further 
outputted from the second input I/F unit 43 to the see-through back image correction unit 

20 44. After the see-through correction, the see-through back image correction unit 44 

outputs the corrected image data to the image quality control unit 45. The image quality 
control unit 45 processes the image data by an area gradation process and outputs the 
processed image data to the video control unit 1 1 via the second output I/F unit 46. The 
area gradation process in the image quality control xmit 45 includes an intensity level 

25 conversion, a dithering process and an error diffusion process, and a major process is an 
area approximation of gradation information. The command control unit 47 controls the 
process flow among the scanner image process imit 41, the see-through back image 
correction unit 44 and the scanner image process imit 41 . 

30 The memory unit 9 stores the corrected image data that has been processed by the 

scanner image process unit 41, and the scanner image process unit 41 processes the stored 
data in various maimers to generate print image data. For example, by changing a number 



9 



RCOH-1032/A01-134 PATENT 

of lines in the dither matrix or an intensity level of the reproduced image, the appearance of 
the reproduced image is modified. As described above, it is not necessary to read the 
image data from the scaiming unit 1 every time the process is modified, but the stored 
image data is read from the memory unit 9. The same image data is reused for various 
5 image processing. 

Now referring to FIGURE 4, a block diagram illustrates another preferred 
embodiment of the image process unit 4 according to the current invention. The image 
process unit 4b ftirther includes a plurality of input/output (I/O) ports for inputting and 

10 outputting data to and from the external devices; bus switches/local memory xmits 52; a 
memory control unit 53 for controUiag memory areas and data paths that the bus 
switches/local memory units 52 utilize; a processor array 54 for processing the image data 
stored in the switches/local memory units 52 and for storing the processed image data back 
in the switches/local memory imits 52; a program RAM 55 for storing parameters used for 

15 processing by the processor array 45; a data RAM 56 and a host buffer unit 57. 

Now referring to FIGURE 5, a block diagram illustrates one preferred 
embodiment the image memory access control unit 6 according to the cxnrent invention. 
The image memory access control unit 6 further includes a parallel data interface (I/F) unit 

20 61, a data conversion unit 62, a data compression vmit 63, a data decompression unit 64, a 
memory access control xmit 65, a system control unit 66, a line buffer unit 67 and a video 
control unit 68. The code data from an external personal computer 10 is stored m a local 
area in the line buffer 67, and the video control unit 68 process the code data into image 
data based upon a process command from the system control unit 7 via the system control 

25 unit 66. The above processed image data and image data in the parallel data I/F unit 61 

from the image data control unit 3 via the parallel bus 5 are then stored in the memory unit 
9. The data conversion unit 62 selects the image data, and the data compression unit 63 
compresses the selected image data for efficient storage. The memory access control unit 
65 stores the compressed image data in the memory unit 9 while the memory access 

30 control unit 65 keeps track of the address in the memory unit 9. To read the stored data 
from the memory unit 9, the memory access control unit 65 specifies a read begin address. 
The data decompression unit 64 decompresses the image data that have been read from the 
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memory unit 9, and the data conversion unit 62 transfers the converted data to the parallel 
bus 5 via the parallel data I/F unit 6 1 . 

Now referring to FIGURE 6, a block diagram illustrates one preferred 
5 embodiment the video control unit 1 1 according to the current invention. In general, the 
video data control unit 1 1 further processes the output image data from the image process 
unit 4 according to the characteristics of the image formation xmit 12. The video data 
control unit 1 1 further includes an edge smoothing process unit 1 101, a pulse control unit 
1 102, a parallel data interface (I/F) unit 11 03, a data conversion unit 1 104 and a serial data 

10 interface (I/F) unit 1 105. The edge smoothing process unit 1101 processes the output 

image data from the unage process unit 4b for rearranging dots, and the pulse control unit 
1 102 performs the pulse control process on the edge smoothed data for forming dots. The 
pulse control unit 1 102 subsequently outputs the processed image data to the image 
formation unit 12. In addition to the above output data conversion, the data conversion 

15 unit 1 104 converts the format of serial data jfrom the serial data I/F unit 11 05 and parallel 
data from the parallel data I/F unit 1 103. The video data control unit 1 1 alone manages the 
communication between the system control xmit 7 and the process control unit 8. 

The above described digital copier sends the image data scanned from the front 
20 side of the document by the scanner unit 1 to the sensor board imit 2, the image data 

control imit 3 and the image process unit 4 in this order. The image data is stored in stored 
in the memory unit 9 via the image data control unit 3, the parallel bus 5 and the image 
memory access control unit 6. When the image data is outputted from the memory unit 9, 
the image data is fnst sent to the image data control unit 3 via the parallel bus 5 and the 
25 image memory access control unit 6. Subsequently, the image data is sent from the image 
data control unit 3 to the image formation unit 12 to form a transfer unage via the image 
process unit 4 and the video data control unit 1 1 . 

As described above, the scanner 1 reads the front and back of a document, and the 
30 image data is stored in the memory imit 9. When the scanned image data is outputted from 
the memory unit 9, the image memory access control unit 6 reads the front side image data 
in the same order as it has been scanned. On the other hand, when the back side image 
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data is outputted from the memory imit 9, the image memory access control unit 6 reads 
the back side image data in such manner that the back side image is seen through the front 
side. In other words, the back side image data is read as if their positions corresponding to 
the front side image data are reversed in the left and right direction. The above described 
5 front and back side image data from the image memory access control unit 6 are sent to the 
image process unit 4 via the image data control xmit 3. The see-through back image 
correction ixnit 44 corrects the front and back image data from the image process unit 4. 

Referring to FIGURES 7, a graph illustrates one exemplary image data to be sent 
10 to the see-through back image correction unit 44. FIGURE 7 A is a graph illustrating 

exemplary front image data 81 while FIGURES 7B1, 7B2 and 7B3 are graphs respectively 
illustrating back image data S2si, 82b and 82c. The front image data 81 includes the image 
data representing an image printed on the front side as well as a see-through back image 
that is seen on the front side through the semi-transparent document. The back image data 
15 82a5 82b and 82c respectively represent a dot pattem image, a character portin image and a 
graphic portion image. The X axis and the Y axis in these graphs respectively represent 
positions and image data values. The higher the X value is, the darker the image appears. 

Referring to FIGURE 8, a block diagram illustrates one preferred embodiment of 
20 the see-through back image correction process unit 44 according to the current invention. 
The see-through back image correction process unit 44 fiarther includes an edge amount 
detection xmit 441, a smoothing unit 442, a determination unit 443 and an intensity level 
correction unit 444. The edge amount detection imit 441 extracts edge portions of the 
output image data. The smoothing unit 442 smoothes the edge extracted portions while the 
25 determination unit 443 isolate the see-through image portions from the original front image 
portions based upon the binarized data that has been generated according to a 
predetermined threshold value. The intensity level correction unit 444 thus removes the 
see-through portions in the output image data based upon the results from the 
determination unit 443. 



30 



As described above, the edge amount detection unit 441 extracts edge portions of 
the output image data. For example, even though an image on the back side of a document 
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is clear, edges of a see-though image is generally blurred as it is seen through the 
document. On the other hand, a low contrast print image such as a character portion and a 
dot pattern portion have sharp edges even if the average intensity level is low. Based upon 
the above distinction or characteristics of edges, an image is determined whether it is 
original or see-through. To detect the edges, for example, a filter LI such as shown in 
FIGURE 9 is appUed to the firont image 81 of the output image data as shown in FIGURE 
7 A. As the result of the above described edge detection, FIGURE 1 OA is a graph 
illustrating the edges as represented by peaks 83. By this detection method, the see- 
through image is separated from the edge portions of a low contrast image. However, 
when the edges 83 are determined by the above method, since iimer portions of characters 
are not determined as edges, the character inner portions may be mistaken as see-through 
back image portions. 

To avoid the above undesirable errors, the smoothing unit 442 smoothes the edge 
extraction results from the edge amount detection unit 441 by using a smoothing filter L2 
such as shown in FIGURE 11. FIGURE 1 OB is a graph that represents a smoothed image 
84 for an original front image 81 as shown m FIGURE 7A. The determination unit 443 
binarizes the smoothed unage data according to a predetermined threshold value so as to 
isolate character portions and graphics portion in a low contrast image area. 
Subsequently, the intensity level correction unit 444 removes the undesirable see-through 
back image portions from the output image data based upon the extraction results from the 
determination unit 443 while it is referring to a gamma characteristic conversion line such 
as shown in FIGURE 12. 

FIGURE 12 is a graph illustrates an exemplary input and output characteristics. 
The X axis indicates an input intensity value while the Y axis indicates an output intensity 
value. An intensity value from 0 signifying white to 255 signifying black. For character 
and dot pattern portions, input data is outputted without modifying by applying a linear y 
characteristics line (a) that goes through the origin. For other background portions, in 
order to remove portions below a predetermined threshold value, another linear y 
characteristics line (b) is applied. By using a certain linear y characteristics line, a desirably 
shaded front image is obtained after removing see-through back image portions. 
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Subsequently, enlargement or reduction or image quality processes are performed before 
the image data is outputted to the video control unit 1 1 . Finally, the image forming unit 12 
prints out the image on an image-carrying medium. The above described method and 
devices substantially eliminate the undesirable see-through back image problem in 
duplicating two-sided documents. 

FIGURES 13A and 13B describe a second preferred process of substantially 
eliminating the undesirable see-through back image problem in duplicating two-sided 
doctiments according to the current invention. FIGURE 13A is a graph depicting the edge 
detection data from the edge amoimt detection unit 441 that has been binarized by the 
determination unit 443. Since the above data allows only the extraction of the character 
edges, the extracted edge portion is expanded to neighboring areas such as to four 
neighboring pixels as shown hi FIGURE 13B. This expansion enables the extraction of 
inner areas of a character as well as dot pattern areas. By using the results from the 
improved extraction method, the intensity correction unit 444 removes the undesirable see- 
through back image areas while it is referencing to a gamma characteristic conversion table 
that is constructed from a gamma ftmction such as shown in FIGURE 12, Thus, the low 
contrast characters are not erroneously determined as a see-through back image. 

FIGURE 14 describes a third preferred process of substantially eliminating the 
undesirable see-through back image problem in duplicating two-sided documents 
according to the current invention. The above described preferred processes utilize 
information on edge portions and non-edge portions to activate the see-through back image 
removal process. The above described preferred processes thus lower the intensity level of 
certain portions such inner portions of thick character lines based upon the gamma 
characteristic conversion table as shown in FIGURE 12B. Consequently, an undesirable 
side effect is that certain dark portions are not completely filled at an original darkness. 
For these reasons, the third preferred process selects a technique based upon an intensity 
level of an original document to be duplicated. That is, when the intensity level of an input 
document is below a predetermined threshold value, even if a portion is a non-edge, the 
above described see-through back image removal process is not performed. For example, 
the predetermined threshold value depends upon the transparency of a certain standard 



14 



RCOH-1032/A01-134 PATENT 

thickness of a sheet of paper. When the intensity level of an input document exceeds the 
darkest intensity of a see-through back image, even if a portion is a non-edge, the portion is 
not determined as a see-through back image. 

5 FIGURE 14 is a graph depicting a gamma characteristic conversion curve to be 

used for the above described third preferred process. When the intensity level of an input 
document is below a predetermined threshold value, depending upon the detection of an 
edge, the third preferred process switches between the first gamma characteristics function 
(a) and the second gamma characteristics function (b). On the other hand, when the 
10 intensity level of an input document is above the predetermined threshold value, regardless 
of the presence of an edge, no gamma conversion is applied. Thus, third preferred 
embodiment performs the correction based upon the intensity level and prevents the 
duplicated image from having imdesirably low intensity portions due to the see-through 
back image correction on non-edge high intensity portions. 

15 

In the graph of FIGURE 14, the X axis is an iaput value range from 0 to 255, and 
The Y axis is an output value range from 0 to 255. While x is smaller than a 
predetermined threshold Th, for an edge portion, x = y. On the other hand, for a non-edge 
portion, y = (2x + Th). These two variables are used as a parameter in software 
20 implementation, and a SIMD processor can change a gamma ciirve in real time on a pixel 
basis. 

FIGURE 15 is a diagram illustrating a fourth preferred embodiment for 
substantially eliminating the xmdesirable see-through back image problem in duplicating 

25 two-sided documents according to the current invention. The above described preferred 
processes utilize information on edge portions and non-edge portions to activate the see- 
through back image removal process. However, when the average intensity level is 
sufficiently high, there is no need to perform the see-through back image removal process. 
For example, when the input document is in color and has a low intensity dot pattern, 

30 since edges are not sufficiently detected by the filter LI as shown in FIGURE 9, it is 
difficult to separate front dot pattern images from see-through back images. The above 
separation is especially difficult when a yellow dot pattern document is scanned by a 

15 



RCOH-1032/A01-134 PATENT 

black-and-white scanner. In these cases, it is determined whether or not an image has a 
pitch frequency, and the determination enables to separate low intensity dot pattern images 
with weak edges from see-through back images. 

5 Still referring to FIGURE 1 5, the fourth preferred embodiment of the see-through 

back image correction unit 44 further includes an average level detection unit 445, an edge 
amount detection unit 441, a pitch frequency detection unit 446, a determination imit 447 
and a level correction unit 444. The see-through back image correction unit 44 performs 
the see-through back image removal process on output image data when the output image 
10 has weak edges, no pitch frequency and has an average intensity level that is smaller than a 
predetermined value. 

Referring to FIGURE 16, a flow chart illustrates steps involved in a preferred 
process of substantially eliminating the undesirable see-through back image problem in 

15 duplicating two-sided docimients according to the current invention. The preferred process 
includes step SI of determining an average intensity level. For example, as FIGURE 7A 
shows, after a front image 81 of output image data is sent to the see-through back image 
correction unit 44, the average level detection unit 445 determines an average intensity 
value and sends it to the determination unit 447, In step 2, the determination imit 447 

20 compares the average intensity value to a predetenmned threshold value. When the 

average intensity value is larger than the threshold value, the preferred process proceeds to 
step 8, where no process is performed. The determination unit 447 generates no see- 
through back hnage removal signal and sends the output image data to the level correction 
unit 444. Upon receiving no see-through back image removal signal and the output image 

25 data, the level correction unit 444 outputs the output image without performing the see- 
through back image removal process. On the other hand, when the average intensity value 
is smaller than the threshold value, the preferred process proceeds to step 3. The 
determination unit 447 generates a signal indicative of the small average intensity value 
and sends it to the edge amount detection unit 441 . 

30 

Still referring to FIGURE 16, upon receiviag the small average intensity signal, 
the edge amount detection unit 441 determines an edge amount of the output image data 
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and sends it to the determination unit 447 in the step 3. The determination unit 447 
determines in step 4 that the output image data represents an original front image when the 
detected edge amount is sufficiently high and generates a front image signal. The 
determination unit 447 then sends the output image data and the front image signal to the 
5 level correction unit 444. In step 8, the level correction unit 444 outputs the output image 
without performing the see-through back image removal process. On the other hand, when 
the detected edge amount is not sufficiently high in step 4, the determination unit 447 
generates a non-front image signal and sends it to the pitch frequency detection unit 446. 
In step 5, in response to the non-front image signal, the pitch frequency detection unit 446 
10 detects the pitch frequency of the output image data and sends it to the determination unit 
447. Based upon the pitch frequency, the determination unit 447 determines whether or 
not the output image indeed has the detected pitch frequency in step 6. When the 
S determination unit 447 determines that the output image data has the detected pitch 

0 frequency and is a front dot pattern image as shown in FIGURE 17 A, the determination 

A 15 unit 447 generates a front dot pattern image signal and sends it to the level correction unit 

444. In response to the front dot pattern image signal, in step 8, the level correction unit 
fj 444 outputs the oxitput image without performing the see-through back image removal 

process. On the other hand, when the determination unit 447 determines that the output 
S image data fails to have the detected pitch frequency, the level correction unit 444 

2 20 performs the see-through back image removal process in step 7 and sends the removed see- 

5 through back image to the image quality control imit 45 in step 9. Thus, in the above steps, 

^ it is determined whether or not an image has a pitch frequency, and the determination 

enables to separate low intensity dot pattem images with weak edges from see-through 
back images so as to form a front image 86 as shown in FIGURE 17B. 

25 

The pitch frequency detection unit 446 performs the frequency analysis of an 
image based upon the distribution Fourier transformation (DFT) as well as determines a 
peak, a valley or a self-correlation fimction for the image. Based upon the above 
detections, the presence of a pitch frequency is determined. When the DFT is used for the 
30 frequency analysis, FIGURE ISA illustrates an oscillation spectrum after the DTF is 

appUed to a front image 81 of an output image data. FIGURE 18B illustrates an oscillation 
spectrum of a see-through back image. Although the above DFT is two-dimensional DFT, 
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FIGURES 1 8A and 1 8B illustrate only one dimension. As shown in FIGURE 1 8 A, a dot 
pattern image having a pitch frequency indicates clear spectrum peaks. In contrast, a see- 
through back image that does not have a pitch frequency fails to indicate spectrum peaks. 
Based upon the above spectrum peaks appearance, the dot patter image is distinguished 
5 from the see-through back image. For example, if an image signal and its DFT are 

respectively represented by x(m, n) and X(m, n), the oscillation spectrum is represented as 
|X (m, n)|. The max value, max |X (m, n)| is first determined. Equation (1) below shows 
that max |X (m, n)| is then normalized by the sum of the entire spectrum. If the above 
value is larger than or equal to a predetermined threshold value T, an image is determined 
10 to be a dot pattern image with a pitch frequency. 



\X(m,n)\ 



X|X(m,«)| 

m=0,n=0 



A self-correlation ftinction is used to determine whether or not a pitch frequency 
15 exists. FIGURE 19A diagrammatically illustrates the image data in the main scanning 
direction, and the same waveform periodically repeats for the front dot pattern image. On 
the other hand, as shown in FIGURE 19B, the same waveform fails to periodically repeat 
for the see-through back image. Using the above distinction, the self correlation ftinction 
R,x(^^) is determined using the following equation (2) in order to separate the dot pattern 
20 image from the see-through back image. 



1 iV-l-m 

RJm)-- 2]x(n)x(n + m) (^-0,1,2, ^iW) (2) 

N-m tt 



In the equation (2), the data x (n + m) is the image data x(n) that is moved by m, and the 
25 sum of the product by x(n) is determined. In case of a dot pattern image that is expressed 
by the periodic wave form, the self correlation function, R^xCi^i) has a large value and x (n) 
and X (n + m) have the same wave form when the value of m matches a period of dot 
pattern. When the maximal value R^(m) max is larger than a predetermined threshold 
value, an image is determined as a dot pattern image. 
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Subsequently, by determiiiing a peak and a valley of an image, the presence of a 
pitch jfrequency is detected. As shown in FIGURE 20, N x 3 pixel matrix Ml is formed, 
and D (2, 2) is designated as a current pixel. For example, when N = 9, 9 x 3 matrix Ml is 
used. Within the 9 x 3 pixel matrix Ml, small matrixes M2, M3, M4 through M(N-1) are 
formed. The center pixel of these matrixes M2, M3, M4 through M(N-1) is determined to 
be a peak when the center pixel has a larger value than the eight surroimding pixels. That 
is, when the following equation holds, D(2, n) is a peak. Conversely, when the center pixel 
has a smaller value than the surrounding pixels, the center pixel is a valley pixel. 

[D(2,n) >D(1, n-1)] & [D(2,n)>D(l,n)] & [D(2,n) >D(1, n+1)] & 
[D(2,n) >D(2, n-1)] & [D(2,n)>D(2,n+l)] & [D(2,n) >D(3, n-1)] & 
[D(2,n) >D(3, n)] & P(2,n)>D(3,n+l)] 

Conversely, when the center pixel has a smaller value than the surrounding pixels, the 
center pixel is a valley pixel That is, when the following equation holds, D(2, n) is a 
valley. 

[D(2,n) <D(1, n-1)] & [D(2,n) <D(l,n)] & P(2,n) <D(1, n+1)] & 
[D(2,n) <D(2 n-1)] & [D(2,n) <D(2n+l & [D(2,n) <D(3 n-1)] & 
[D(2,n) <D(3, n)] & [D(2,n) <D(n)] & [D(3, n+1)] 

The above described peak and valley detections are performed by sUding the matrixes M2, 
M3, M4 through M(N-1) within the 9 x 3 matrix ML When more than two peaks or 
valleys are found within the 9 x 3 matrix Ml, the current pixel D (2, n) is determmed to be 
a dot pattern. 

The above described preferred embodiment determines an average intensity of 
output image data and then determines the edge amount. Although the pitch frequency is 
subsequently described, the average intensity detection, the edge amount detection and the 
pitch frequency detection are performed in parallel. When the average intensity of the 
output image is smaller than the predetermined value, the edges are weak, and no pitch 
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frequency exists, a see-through back image removal process is performed on the output 
image data. 



In processing the see-through back image removal process on the output image 
5 data, it is desirable to vary the level of the see-through back image removal depending 
upon the document scanned by the scaimer unit 1 . For example, after specifying that a 
document is double-sided or single-sided via opemtional panel 19, the process control unit 
8 reads the and sends the read value to the image process unit 4 via the image data control 
unit 3. When an input document is specified as single-sided, the scanner 1 scans only one 

10 side. Since it is likely that the input document is single-sided, the image process unit 4 sets 
the variable level of the see-through back image removal process to a relatively low value. 

On the other hand, when an input document is specified as double-sided, the scanner 1 
scans both sides. Since it is likely that the input document is double-sided, the image 
process unit 4 sets the variable level of the see-through back image removal process to a 

15 relatively high value. By the above described manner, by setting the variable level for the 
see-through back image removal process to a relatively high value, the see-through image 
is prevented from remaining. At the same time, an undesirable side-effect of removing 
information by setting the variable level of the see-through back image removal process to 
a relatively low value for the single-sided document is minimized. 

20 

In addition to the single-side and double-sided selection, it is also desirable to use 
the variable level of the see-through back image removal process based upon the image 
quahty mode and the paper thickness of the input document. That is, the image quality 
mode includes a character mode and a photograph mode. The character mode is usually 

25 used. In this mode of duplication, two-sided documents are often used, and the documents 
to be duplicated are generally expressed in half-tone dot patterns. On the other hand, the 
documents to be duplicated in the photograph mode have both half-tone dot patterns and 
continuous gradation such as in silver halide pictures. Since in either mode, it is rare to 
have double-sided documents for duplication. When the image quality mode is the 

30 character mode, the see-through back image removal is strengthened to prevent the see- 
through back image. When the image quality mode is the photograph mode, the see- 



20 



RCOH-1032/A01-134 PATENT 

through back image removal is weakened to prevent the undesirable removal of 
information. 



In order to separate image data from the front side and the back side, a double- 
sided mode is provided using a high intensity plate. When the high intensity plate is used 
v^ith a highly transparent document, the light reflected off the plate suppresses a see- 
through back image by Hghting the front side of the document from the back side. The 
intensity of the background on the front side thus increases. 

It is to be understood, however, that even though numerous characteristics and 
advantages of the present invention have been set forth in the foregoing description, 
together with details of the structure and ftmction of the invention, the disclosxire is 
illustrative only, and that although changes may be made in detail, especially in matters of 
shape, size and arrangement of parts, as well as implementation in software, hardware, or a 
combination of both, the changes are within the principles of the invention to the frill 
extent indicated by the broad general meaning of the terms in which the appended claims 
are expressed. 
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